Basis (linear algebra)

Basis vector redirects here. For basis vector in the context of crystals, see crystal structure.

In linear algebra, a basis is a set of vectors that, in a linear combination, can represent every vector in a given vector space or free module, and such that no element of the set can be represented as a linear combination of the others. In other words, a basis is a linearly independent spanning set, or more simply put a "coordinate system".[1]

Contents

Definition

This picture illustrates the standard basis in R2. The blue and orange vectors are the elements of the basis; the green vector can be given in terms of the basis vectors, and so is linearly dependent upon them.

A basis B of a vector space V over a field F is a linearly independent subset of V that spans (or generates) V.

In more detail, suppose that B = { v1, …, vn } is a finite subset of a vector space V over a field F (such as the real or complex numbers R or C). Then B is a basis if it satisfies the following conditions:

for all a1, …, an ∈ F, if a1v1 + … + anvn = 0, then necessarily a1 = … = an = 0; and
for every x in V it is possible to choose a1, …, an ∈ F such that x = a1v1 + … + anvn.

The numbers ai are called the coordinates of the vector x with respect to the basis B, and by the first property they are uniquely determined.

A vector space that has a finite basis is called finite-dimensional. To deal with infinite-dimensional spaces, we must generalize the above definition to include infinite basis sets. We therefore say that a set (finite or infinite) B ⊂ V is a basis, if

The sums in the above definition are all finite because without additional structure the axioms of a vector space do not permit us to meaningfully speak about an infinite sum of vectors. Settings that permit infinite linear combinations allow alternative definitions of the basis concept: see Related notions below.

It is often convenient to list the basis vectors in a specific order, for example, when considering the transformation matrix of a linear map with respect to a basis. We then speak of an ordered basis, which we define to be a sequence (rather than a set) of linearly independent vectors that span V: see Ordered bases and coordinates below.

Properties

Again, B denotes a subset of a vector space V. Then, B is a basis if and only if any of the following equivalent conditions are met:

Every vector space has a basis. The proof of this requires the axiom of choice. All bases of a vector space have the same cardinality (number of elements), called the dimension of the vector space. This result is known as the dimension theorem, and requires the ultrafilter lemma, a strictly weaker form of the axiom of choice.

Also many vector sets can be attributed a standard basis which comprises both spanning and linearly independent vectors.

Standard bases for example:

In Rn {E1,...,En} where En is the n-th column of the identity matrix which consists of all ones in the main diagonal and zeros everywhere else. This is because the columns of the identity matrix are linearly independent can always span a vector set by expressing it as a linear combination.

In P2 where P2 is the set of all polynomials of degree at most 2 {1,x,x2} is the standard basis.

In M22 {M1,1,M1,2,M2,1,M2,2} where M22 is the set of all 2x2 matrices. and Mm,n is the 2x2 matrix with a 1 in the m,n position and zeros everywhere else. This again is a standard basis since it is linearly independent and spanning.

Examples

Extending to a Basis

Let S be a subset of a vector space V. To extend S to a basis means to find a basis B that contains S as a subset. This can be done iff S is linearly independent. Almost always, there is more than one such B, except in rather special circumstances (i.e. L is already a basis, or L is empty and V has two elements).

A similar question is when does a subset S contain a basis. This occurs iff S spans V. In this case, S will usually contain several different bases.

Proving that a finite spanning set is a basis

To prove that a finite spanning set B is a basis for a finite-dimensional vector space V, it is sufficient to show that the number of elements in B equals the dimension of V, and one of the following:

This does not work for infinite-dimensional vector spaces.

Example of alternative proofs

Often, a mathematical result can be proven in more than one way. Here, using three different proofs, we show that the vectors (1,1) and (−1,2) form a basis for R2.

From the definition of basis

We have to prove that these two vectors are linearly independent and that they generate R2.

Part I: To prove that they are linearly independent, suppose that there are numbers a,b such that:

a(1,1)+b(-1,2)=(0,0). \,

Then:

(a-b,a+2b)=(0,0) \,
  and  
a-b=0 \;
  and  
a+2b=0. \,

Subtracting the first equation from the second, we obtain:

3b=0 \;
  so  
b=0. \,

Subtracting this equation from the first equation then:

a=0. \,

Part II: To prove that these two vectors generate R2, we have to let (a,b) be an arbitrary element of R2, and show that there exist numbers r,s ∈ R such that:

r(1,1)+s(-1,2)=(a,b). \,

Then we have to solve the equations:

r-s=a \,
r+2s=b. \,

Subtracting the first equation from the second, we get:

3s=b-a, \,
          and then
s=(b-a)/3, \,
        and finally
r=s+a=((b-a)/3)+a=(b+2a)/3. \,

By the dimension theorem

Since (−1,2) is clearly not a multiple of (1,1) and since (1,1) is not the zero vector, these two vectors are linearly independent. Since the dimension of R2 is 2, the two vectors already form a basis of R2 without needing any extension.

By the invertible matrix theorem

Simply compute the determinant

\det\begin{bmatrix}1&-1\\1&2\end{bmatrix}=3\neq0.

Since the above matrix has a nonzero determinant, its columns form a basis of R2. See: invertible matrix.

Ordered bases and coordinates

A basis is just a set of vectors with no given ordering. For many purposes it is convenient to work with an ordered basis. For example, when working with a coordinate representation of a vector it is customary to speak of the "first" or "second" coordinate, which makes sense only if an ordering is specified for the basis. For finite-dimensional vector spaces one typically indexes a basis {vi} by the first n integers. An ordered basis is also called a frame.

Suppose V is an n-dimensional vector space over a field F. A choice of an ordered basis for V is equivalent to a choice of a linear isomorphism φ from the coordinate space Fn to V.

Proof. The proof makes use of the fact that the standard basis of Fn is an ordered basis.

Suppose first that

φ : Fn → V

is a linear isomorphism. Define an ordered basis {vi} for V by

vi = φ(ei) for 1 ≤ i ≤ n

where {ei} is the standard basis for Fn.

Conversely, given an ordered basis, consider the map defined by

φ(x) = x1v1 + x2v2 + ... + xnvn,

where x = x1e1 + x2e2 + ... + xnen is an element of Fn. It is not hard to check that φ is a linear isomorphism.

These two constructions are clearly inverse to each other. Thus ordered bases for V are in 1-1 correspondence with linear isomorphisms Fn → V.

The inverse of the linear isomorphism φ determined by an ordered basis {vi} equips V with coordinates: if, for a vector v ∈ V, φ−1(v) = (a1, a2,...,an) ∈ Fn, then the components aj = aj(v) are the coordinates of v in the sense that v = a1(v) v1 + a2(v) v2 + ... + an(v) vn.

The maps sending a vector v to the components aj(v) are linear maps from V to F, because of φ−1 is linear. Hence they are linear functionals. They form a basis for the dual space of V, called the dual basis.

Related notions

Analysis

In the context of infinite-dimensional vector spaces over the real or complex numbers, the term Hamel basis (named after Georg Hamel) or algebraic basis can be used to refer to a basis as defined in this article. This is to make a distinction with other notions of "basis" that exist when infinite-dimensional vector spaces are endowed with extra structure. The most important alternatives are orthogonal bases on Hilbert spaces, Schauder bases and Markushevich bases on normed linear spaces.

The common feature of the other notions is that they permit the taking of infinite linear combinations of the basic vectors in order to generate the space. This, of course, requires that infinite sums are meaningfully defined on these spaces, as is the case for topological vector spaces – a large class of vector spaces including e.g. Hilbert spaces, Banach spaces or Fréchet spaces.

The preference of other types of bases for infinite dimensional spaces is justified by the fact that the Hamel basis becomes "too big" in Banach spaces: If X is an infinite dimensional normed vector space which is complete (i.e. X is a Banach space), then any Hamel basis of X is necessarily uncountable. This is an easy consequence of Baire category theorem. The completeness as well as infinite dimension are crucial assumptions in the previous claim. Indeed, finite dimensional spaces have by definition finite basis and there are infinite dimensional (non-complete) normed spaces which have countable Hamel basis. Consider c_{00}, the space of the sequences x=(x_n) of real numbers which have only finitely many non-zero coordinates, with the norm \|x\|=\sup_n |x_n|. The standard basis is its countable Hamel basis.

Example

In the study of Fourier series, one learns that the functions {1} ∪ { sin(nx), cos(nx) : n = 1, 2, 3, ... } are an "orthogonal basis" of the (real or complex) vector space of all (real or complex valued) functions on the interval [0, 2π] that are square-integrable on this interval, i.e., functions f satisfying

\int_0^{2\pi} \left|f(x)\right|^2\,dx<\infty.

The functions {1} ∪ { sin(nx), cos(nx) : n = 1, 2, 3, ... } are linearly independent, and every function f that is square-integrable on [0, 2π] is an "infinite linear combination" of them, in the sense that

\lim_{n\rightarrow\infty}\int_0^{2\pi}\biggl|a_0+\sum_{k=1}^n \bigl(a_k\cos(kx)+b_k\sin(kx)\bigr)-f(x)\biggr|^2\,dx=0

for suitable (real or complex) coefficients ak, bk. But most square-integrable functions cannot be represented as finite linear combinations of these basis functions, which therefore do not comprise a Hamel basis. Every Hamel basis of this space is much bigger than this merely countably infinite set of functions. Hamel bases of spaces of this kind are typically not useful, whereas orthonormal bases of these spaces are essential in Fourier analysis.

Geometry

The related notions of an affine space, projective space, convex set, and cone have related notions of affine basis[2] (a basis for an n-dimensional affine space is n+1 points in general linear position), projective basis (essentially the same as an affine basis, this is n+1 points in general linear position, here in projective space), convex basis (the vertices of a polytope), and cone basis[3] (points on the edges of a polygonal cone); see also a Hilbert basis (linear programming).

See also

Notes

  1. ↑ Halmos, Paul Richard (1987) Finite-dimensional vector spaces (4th edition) Springer-Verlag, New York, page 10, ISBN 0-387-90093-4
  2. ↑ Notes on geometry, by Elmer G. Rees, p. 7
  3. ↑ Some remarks about additive functions on cones, Marek Kuczma

References

General references

Historical references

External links

Topics related to linear algebra
Scalar  · Vector · Vector space · Vector projection  · Linear span · Linear map · Linear projection · Linear independence · Linear combination · Basis · Column space · Row space · Dual space · Orthogonality · Rank · Minor · Kernel (matrix)  · Eigenvalue, eigenvector and eigenspace  · Least squares regressions · Outer product · Inner product space · Dot product · Transpose · Gram–Schmidt process · Matrix decomposition